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What is claimed is: 

1 . A processor-based system operating according to digitally-embedded programming 
instructions and communicating with one or more digital data storage media for classifying and 
archiving images including face regions that are acquired with a digital image acquisition device, 
the programming instructions comprising: 

(a) a face detection module for identifying a group of pixels corresponding to a face 
region within digital image data acquired by the acquisition device; 

(b) a normalization module for generating a normalized face region from said face 
region, including pose normalizing said face region; 

(c) a face recognition module for extracting a set of values of face classifier parameters 
from said normalized face region, said set of face classifier parameter values being collectively 
known as a faceprint associated with said normalized face region; 

(d) a workflow module for comparing said extracted faceprint to a database of archived 
faceprints previously determined to correspond to one or more known identities, and for 
determining based on the comparing whether the new faceprint corresponds to any of the one or 
more known identities, the workflow module further for associating the new faceprint and 
normalized face region from which said faceprint is derived with a new or known identity within 
a database comprising other data corresponding to the archived faceprints and associated parent 
images for performing further comparisons with further faceprints; and 

(e) a database module for archiving the data according to the associating by the workflow 
module within one or more digital data storage media. 

2. The system of claim 1, wherein the identifying by the face detection module comprises 
determining a probability that the group of pixels comprises a face region. 

3. The system of claim 2, wherein the identifying further comprises determining whether the 
probability lies above a predetermined threshold, and if not, automatically determining that the 
group of pixels does not comprise a face region. 
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4. The system of claim 1, wherein the pose normalizing comprises: 

(i) determining the pose of a confirmed face region; 

(ii) mapping said face region onto a 3d average-face model to create an interim 3d model 
of said face region; 

(iii) rotating said interim 3d model into full frontal alignment; and 

(iv) translating the facial aspect of said interim 3d model back onto 2d image space to 
create a pose normalized face region. 

5. The system of claim 4, wherein the determining of the pose of a confirmed face region further 
comprises: 

(i) determining locations of principle facial feature within said face region; 

(ii) determining at least two geometric relationships between said facial features; 

(iii) extrapolating from said geometric relationships the plane of the facial region, relative 
to the normal plane of the image acquisition apparatus thereby determining the facial pose 
relative to the normal plane of the image acquisition apparatus. 

6. The system of claim 5, wherein said principle facial features comprise at least two of eye-pair, 
nose and mouth regions. 

7. The system of claim 4, wherein said determining of the pose of a confirmed face region 
comprises: 

(i) determining the locations of principle facial feature within said face region; 

(ii) determining at least two geometric relationships between said facial features; and 

(iii) extrapolating from said geometric relationships the plane of the facial region relative 
to the normal plane of the image acquisition apparatus, thereby determining the facial pose 
relative to the normal plane of the image acquisition apparatus. 

8. The system of claim 4, wherein said mapping of said face region onto a 3d average-face 
model comprises an additional rescaling of said 3d average face model along at least one 
horizontal dimension, said additional rescaling being based on the at least two geometric 
relationships determined in the pose determining. 
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9. The system of claim 4, wherein the normalizing further comprises performing one or more 
additional normalizing operations on said pose normalized face region. 

10. The system of claim 9, wherein the one or more additional normalization operations 4 
comprise luminance, size, or orientation normalization, or combinations thereof. 

11. The system of claim 1, wherein the workflow module for determining that the new faceprint 
corresponds to a first identity, and the database module for archiving the new faceprint within a 
first face class, and wherein the face recognition module is further for comparing values of face 
classifier parameters of a second face class including a second faceprint image to values of the 
parameters corresponding to the first face class including the new faceprint, as well as to further 
face classes including further faceprints , and for determining based on the comparing whether 
the second faceprint matches any of the first and further face classes. 

12. The system of claim 1, wherein one or more archived faceprints have been previously 
determined to correspond to the one or more known identities, and the comparing by the 
workflow module comprises determining proximities of the values of the face classifier 
parameters of the new face print image with values corresponding to the one or more archived 
faceprints. 

13. The system of claim 12, wherein the proximities of the values correspond to proximities of 
locations in a multi-dimensional mathematical space defined by the set of face classifier 
parameters which correspond to a faceprint. 

14. The system of claim 13, wherein at least one proximity is statistically calculated based on 
comparisons with multiple archived faceprints corresponding to a same identity. 

15. The system of claim 12, wherein the proximities of the values correspond to at least one of 
proximities of color, shape, or relative distances between identified locations within the face 
print images i think it is ok to have such a list. 
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16. The system of claim 1 1, wherein at least one proximity is statistically calculated based on 
comparisons with multiple archived faceprints corresponding to a same identity. 

17. The system of claim 12, wherein the determining by the face recognition module comprises 
automatically determining that the new faceprint corresponds to a known identity based on one 
or more geometric distance proximities being within a predetermined proximity threshold. 

18. The system of claim 17, wherein at least one proximity is statistically calculated to be within 
the threshold when the probability that the proximity is within the threshold is above a 
predetermined probability value. 

19. The system of claim 17, wherein the predetermined proximity threshold comprises a first 
threshold, and the determining by the workflow module comprises requesting user confirmation 
whether the normalized face region associated with the new faceprint corresponds to a known 
identity when a geometric distance proximity is outside the first threshold and within a second 
threshold greater than the first threshold. 

20. The system of claim 19, wherein at least one proximity is statistically calculated to be within 
a threshold when the probability that the proximity is within the threshold is above a 
predetermined probability value. 

21. The system of claim 19, wherein the determining by the workflow module comprises 
automatically determining that the new faceprint does not correspond to a known identity based 
on one or more geometric distance proximities being outside the second threshold or a third 
threshold greater than the second threshold. 

22. The system of claim 12, wherein the determining by the workflow module comprises 
automatically determining that the new faceprint corresponds to a known identity when 
comparisons of the face classifier parameter values of the first face print with multiple archived 
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faceprints corresponding to a same known identity each result in a determination of an identity 
match. 

23. The system of claim 12, wherein the determining by the workflow module comprises 
requesting user confirmation whether the new faceprint corresponds to a known identity when 
comparisons of the face classifier parameter values of the first faceprint with multiple archived 
faceprints corresponding to a same known identity result in at least one determination of an 
identity match and at least one determination that the identities do not match. 

24. The system of claim 12, wherein the determining by the workflow module comprises 
requesting user confirmation whether the new face print image corresponds to one or more 
known identities when comparisons of the face classifier parameter values of the new faceprint 
with multiple archived faceprints corresponding to multiple known identities result in 
determinations of identity matches with at least two different identities. 

25. The system of claim 1, wherein the associating by the workflow module comprises grouping 
the new faceprint with a new or prior face class defined by values of one or more face classifier 
parameters. 

26. The system of claim 25, wherein when the determining by the workflow module results in 
no identity matches between the new faceprint and any known identity, the workflow module 
determines that the new face print image corresponds to a new identity and is grouped with a 
new face class defined by sets of boundary face classifier parameter values, and archives new 
data accordingly. 

27. The system of claim 26, wherein the archiving of the new data corresponding to the face 
classifier parameters of the new faceprint corresponding to the new identity comprises 
associating the new data with archived data corresponding to one or more known identities based 
on a relationship between the new identity and the one or more known identities. 



Gray Cary\SF\3097501 .1 
2100874-991430 



-78- 



Attorney Docket: 2100874-991430 (FN- 103-D) 



28. The system of claim 26, wherein the archiving of the new data corresponding to the face 
classifier parameters of the new faceprint corresponding to the new identity comprises 
associating the new data with a further new identity based on a relationship between the two new 
identities. 

29. The system of claim 25, wherein the archiving of the new data corresponding to the face 
classifier parameters of the new faceprint comprises generating a new face class defined by sets 
of boundary face classifier parameter values including the particular face parameter values of the 
new face print image. 

30. The system of claim 27, wherein the archiving further comprises grouping the new face class 
with another face class within a same identity table corresponding to a same appearance of a 
known identity. 

31. The system of claim 30, wherein the archiving further comprises adjusting boundary face 
classifier parameter values of a different identity based on adjusted boundary values of the 
identity including the new face class. 

32. The system of claim 29, wherein the archiving further comprises grouping the new face class 
within a first identity table, and grouping the first identity table with a second identity table, 
including a second face class, together within a same appearance table corresponding to a 
different appearances of a same known identity. 

33. The system of claim 32, wherein the archiving further comprises adjusting boundary face 
classifier parameter values of a different identity based on new or adjusted boundary values of 
the identity including the new face class. 

34. The system of claim 29, wherein the archiving further comprises grouping the new face class 
within a previously generated identity table including multiple face classes corresponding to 
multiple different values of face classifier parameters corresponding to a same appearance of a 
same identity. 
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35. The system of claim 34, wherein the archiving further comprises adjusting boundary face 
classifier parameter values of the identity based on parameters of the new face class. 

36. The system of claim 35, wherein the archiving further comprises adjusting boundary face 
classifier parameter values of a different identity based on parameters of the adjusted boundary 
values of the identity including the new face class. 

37. The system of claim 25, wherein the archiving of the new data corresponding to the face 
classifier parameters of the new faceprint comprises grouping the new faceprint within a 
previously-determined face class defined by sets of boundary face classifier parameter values 
including particular face classifier parameter values of the new faceprint. 

38. The system of claim 37, wherein the archiving further comprises re-defining the boundaries 
of the previously-determined face class based on one or more particular face classifier parameter 
values of the new faceprint being outside previously established boundary values. 

39. The system of claim 37, wherein the face class has been previously grouped with one or 
more other face classes within a same identity table corresponding to a same known identity, and 
wherein the archiving further comprises adjusting boundary values of the identity table based on 
adjusted boundary values of the face class including the new faceprint. 

Other modules/dependent features 

40. The system of claim 1, wherein the programming instructions further comprise an image 
detection module for determining that a new image is presented for face detection processing. 

41. The system of claim 1, wherein the programming instructions further comprise a set of user 
interface modules for obtaining user input in the detection of face candidate regions, or the 
classifying, archiving or recalling of faceprints or associated normalized face regions, or 
combinations thereof. 
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42. The system of claim 1, wherein the programming instructions are stored on or accessible by 
a stand alone processor-based device configured for receiving raw image data from a digital 
camera, and the device being coupled with or including user interface hardware, and upon which 
the classifying is performed. 

43. The system of claim 1, wherein the programming instructions are stored at least in part on an 
embedded appliance for performing some image classifying-related processing prior to 
outputting processed image data to a further processor-based device upon which the classifying 
is further performed. 

44. The system of claim 43, wherein the embedded appliance comprises a digital camera. 

45. The system of claim 44, wherein the digital camera comprises a dedicated digital camera or 
a camera-capable handheld pda or phone, or a combination thereof. 

46. The system of claim 1, wherein the programming instructions are stored at least in part on a 
processor-based device connected to a network for performing some image classifying-related 
processing on the device prior to outputting processed data to a back-end server upon which the 
classifying is further performed. 

47. The system of claim 1, wherein the identifying by the face detection module or the 
comparing by the face recognition module, or both, comprise receiving and utilizing user input 
confirmation. 

48. The system of claim 1, wherein the identifying by the face detection module or the 
comparing by the face recognition module, or both, are configured for auto-processing subject to 
selective disablement of the auto-processing by a user. 

49. The system of claim 1, wherein the identifying by the face detection module applies 
automatic face region identification when a detection probability is calculated to be above a 
detection probability threshold or the comparing by the face recognition module applies 
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automatic identity recognition when a matching probability with a prior faceprint is calculated to 
be above a matching probability threshold, or both. 

50. The system of claim 49, wherein the detection probability threshold or the matching 
probability threshold, or both, are adjustable. 

5 1 . The system of claim 50, wherein the detection threshold or the matching threshold, or both, 
are adjustable by a user, a manufacturer, or an adaptive learning program of the system, or 
combinations thereof. 

52. The system of claim 1, wherein the programming instructions are stored on or accessible by 
processor-based components within a digital camera upon which the classifying is performed. 

53. The system of claim 1, wherein the set of face classifier parameters are principle component 
vectors derived from a set of eigenface descriptors. 

54. The system of claim 1, wherein the set of face classifier parameters are independent 
component vectors derived from an independent component analysis of a normalized face image. 

55. The system of claim 1, wherein the set of face classifier parameters are fourier components 
derived from a 2d fourier transformation of the normalized face region. 

56. The system of claim 1, wherein the set of face classifier parameters are discrete fourier 
transform vectors derived from a 2d discrete cosine transform of the normalized face region. 

57. The system of claim 1, wherein the set of face classifier parameters are wavelet transform 
components derived from a 2d wavelet transform of the normalized face region. 

58. The system of claim 1, wherein the set of face classifier parameters are gabor transform 
components derived from a 2d gabor transform of the normalized face region. 
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59. The system of claim 1, wherein the set of face classifier parameters comprises a combination 
of two or more of principle components vectors, independent component vectors, fourier 
components, discrete cosine transform components, wavelet transform components and gabor 
transform components. 

60. The system of claim 59, wherein the set of face classifier parameters includes additional 
classifiers or subsets thereof which further characterize the shape, texture, color distribution or 
localized physical features of the face region. 

61 . The system of claim 59, wherein the set of face classifier parameters may be subdivided into 
two or more subsets of face classifier parameters wherein each subset facilitates a particular step 
of the comparing and determining a match of said set of face classifier parameters with a 
previously determined known identity. 

62. The system of claim 61, wherein one of said subsets of face classifier parameters verifies 
that the face region is similar enough to the face region of one or more known identities to be 
correctly recognized; and wherein the second of said subsets of face classifier parameters 
completes the recognition process by determining which of said known identities said face 
region should be associated with. 

63. The system of claim 1, wherein the archiving further for enabling further comparisons with 
further faceprints and for recalling the faceprints and their associated normalized face regions 
and parent images. 

64. The system of claim 1, wherein the normalizing further comprises performing one or more 
additional normalizing operations. 

65. The system of claim 64, wherein the one or more additional normalizing operations 
comprise luminance, size, or orientation normalizing, or combinations thereof. 

66. The system of claim 1, wherein the normalizing further comprises size normalizing. 
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67. A processor-based system operating according to digitally-embedded programming 
instructions and communicating with one or more digital data storage media for classifying and 
archiving images including face regions that are acquired with a digital image acquisition device, 
the programming instructions comprising: 

(a) a normalization module for generating a normalized face region from an identified 
face region within digital image data acquired by the acquisition device, the generating 
comprising pose normalizing of said face region; and 

(b) a workflow module providing for the automatic or semiautomatic processing of the 
pose normalized face region from which face classifier parameter values are extracted and 
collectively referred to as a faceprint, the processing comprising: 

(i) comparing said extracted faceprint to a database of archived faceprints 
previously determined to correspond to one or more known identities, 

(ii) determining based on the comparing whether the new faceprint corresponds to 
any of the one or more known identities, and 

(iii) associating the new faceprint and normalized face region from which said 
faceprint is derived with a new or known identity within a database comprising other data 
corresponding to the archived faceprints and associated parent images for performing further 
comparisons with further faceprints, such as to permit data corresponding to the new faceprint 
and its associated parent image to be archived according to the associating by the workflow 
module within one or more digital data storage media. 

68. The system of claim 67, wherein one or more archived faceprints have been previously 
determined to correspond to the one or more known identities, and the comparing by the 
workflow module comprises determining proximities of the values of the face classifier 
parameters of the new face print image with values corresponding to the one or more archived 
faceprints. 

69. The system of claim 68, wherein the proximities of the values correspond to proximities of 
locations in a multi-dimensional mathematical space defined by the set of face classifier 
parameters which correspond to a faceprint. 
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70. The system of claim 69, wherein at least one proximity is statistically calculated based on 
comparisons with multiple archived faceprints corresponding to a same identity. 

71. The system of claim 68, wherein the proximities of the values correspond to at least one of 
proximities of color, shape, or relative distances between identified locations within the face 
print images. 

72. The system of claim 71 , wherein at least one proximity is statistically calculated based on 
comparisons with multiple archived faceprints corresponding to a same identity. 

73. The system of claim 68, wherein the determining comprises automatically determining that 
the new faceprint corresponds to a known identity based on one or more geometric distance 
proximities being within a predetermined proximity threshold. 

74. The system of claim 73, wherein at least one proximity is statistically calculated to be within 
the threshold when the probability that the proximity is within the threshold is above a 
predetermined probability value. 

75. The system of claim 73, wherein the predetermined proximity threshold comprises a first 
threshold, and the determining by the workflow module comprises requesting user confirmation 
whether the normalized face region associated with the new faceprint corresponds to a known 
identity when a geometric distance proximity is outside the first threshold and within a second 
threshold greater than the first threshold. 

76. The system of claim 75, wherein at least one proximity is statistically calculated to be within 
a threshold when the probability that the proximity is within the threshold is above a 
predetermined probability value. 

77. The system of claim 75, wherein the determining by the workflow module comprises 
automatically determining that the new faceprint does not correspond to a known identity based 
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on one or more geometric distance proximities being outside the second threshold or a third 
threshold greater than the second threshold. 

78. The system of claim 68, wherein the determining by the workflow module comprises 
automatically determining that the new faceprint corresponds to a known identity when 
comparisons of the face classifier parameter values of the first face print with multiple archived 
faceprints corresponding to a same known identity each result in a determination of an identity 
match. 

79. The system of claim 68, wherein the determining by the workflow module comprises 
requesting user confirmation whether the new faceprint corresponds to a known identity when 
comparisons of the face classifier parameter values of the first faceprint with multiple archived 
faceprints corresponding to a same known identity result in at least one determination of an 
identity match and at least one determination that the identities do not match. 

80. The system of claim 68, wherein the determining by the workflow module comprises 
requesting user confirmation whether the new face print image corresponds to one or more 
known identities when comparisons of the face classifier parameter values of the new faceprint 
with multiple archived faceprints corresponding to multiple known identities result in 
determinations of identity matches with at least two different identities. 

81. The system of claim 67, wherein the associating by the workflow module comprises 
grouping the new faceprint with a new or prior face class defined by values of one or more face 
classifier parameters. 

82. The system of claim 81, wherein when the determining by the workflow module results in 
no identity matches between the new faceprint and any known identity, the workflow module 
determines that the new face print image corresponds to a new identity and is grouped with a 
new face class defined by sets of boundary face classifier parameter values, and archives new 
data accordingly. 



Gray Cary\SF\3O97501 .1 
2100874-991430 



-86- 



Attorney Docket: 2100874-991430 (FN- 103-D) 



83. The system of claim 82, wherein the archiving of the new data corresponding to the face 
classifier parameters of the new faceprint corresponding to the new identity comprises 
associating the new data with archived data corresponding to one or more known identities based 
on a relationship between the new identity and the one or more known identities. 

84. The system of claim 82, wherein the archiving of the new data corresponding to the face 
classifier parameters of the new faceprint corresponding to the new identity comprises 
associating the new data with a further new identity based on a relationship between the two new 
identities. 

85. The system of claim 82, wherein the archiving of the new data corresponding to the face 
classifier parameters of the new faceprint comprises generating a new face class defined by sets 
of boundary face classifier parameter values including the particular face parameter values of the 
new face print image. 

86. The system of claim 85, wherein the archiving further comprises grouping the new face class 
with another face class within a same identity table corresponding to a same appearance of a 
known identity. 

87. The system of claim 86, wherein the archiving further comprises adjusting boundary face 
classifier parameter values of a different identity based on adjusted boundary values of the 
identity including the new face class. 

88. The system of claim 85, wherein the archiving further comprises grouping the new face class 
within a first identity table, and grouping the first identity table with a second identity table, 
including a second face class, together within a same appearance table corresponding to a 
different appearances of a same known identity. 

89. The system of claim 88, wherein the archiving further comprises adjusting boundary face 
classifier parameter values of a different identity based on new or adjusted boundary values of 
the identity including the new face class. 



Gray Cary\SF\3097501 .1 
2100874-991430 



-87- 



Attorney Docket: 2100874-991430 (FN- 103-D) 



90. The system of claim 85, wherein the archiving further comprises grouping the new face class 
within a previously generated identity table including multiple face classes corresponding to 
multiple different values of face classifier parameters corresponding to a same appearance of a 
same identity. 

91. The system of claim 90, wherein the archiving further comprises adjusting boundary face 
classifier parameter values of the identity based on parameters of the new face class. 

92. The system of claim 91, wherein the archiving further comprises adjusting boundary face 
classifier parameter values of a different identity based on parameters of the adjusted boundary 
values of the identity including the new face class. 

93. The system of claim 82, wherein the archiving of the new data corresponding to the face 
classifier parameters of the new faceprint comprises grouping the new faceprint within a 
previously-determined face class defined by sets of boundary face classifier parameter values 
including particular face classifier parameter values of the new faceprint. 

94. The system of claim 93, wherein the archiving further comprises re-defining the boundaries 
of the previously-determined face class based on one or more particular face classifier parameter 
values of the new faceprint being outside previously established boundary values. 

95. The system of claim 93, wherein the face class has been previously grouped with one or 
more other face classes within a same identity table corresponding to a same known identity, and 
wherein the archiving further comprises adjusting boundary values of the identity table based on 
adjusted boundary values of the face class including the new faceprint. 

96. The system of claim 67, wherein the programming instructions further comprise an image 
detection module for determining that a new image is presented for face detection processing. 
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97. The system of claim 67, wherein the programming instructions further comprise a set of user 
interface modules for obtaining user input in the detection of face candidate regions, or the 
classifying, archiving or recalling of faceprints or associated normalized face regions, or 
combinations thereof. 

98. The system of claim 67, wherein the programming instructions are stored on or accessible by 
a stand alone processor-based device configured for receiving raw image data from a digital 
camera, and the device being coupled with or including user interface hardware, and upon which 
the classifying is performed. 

99. The system of claim 67, wherein the programming instructions are stored at least in part on 
an embedded appliance for performing some image classifying-related processing prior to 
outputting processed image data to a further processor-based device upon which the classifying 
is further performed. 

100. The system of claim 99, wherein the embedded appliance comprises a digital camera. 

101 . The system of claim 100, wherein the digital camera comprises a dedicated digital camera 
or a camera-capable handheld pda or phone, or a combination thereof. 

102. The system of claim 67, wherein the programming instructions are stored at least in part on 
a processor-based device connected to a network for performing some image classifying-related 
processing on the device prior to outputting processed data to a back-end server upon which the 
classifying is further performed. 

103. The system of claim 67, wherein the programming instructions are stored on or accessible 
by processor-based components within a digital camera upon which the classifying is performed. 

104. The system of claim 67, wherein the set of face classifier parameters are principle 
component vectors derived from a set of eigenface descriptors. 
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105. The system of claim 67, wherein the set of face classifier parameters are independent 
component vectors derived from an independent component analysis of a normalized face image. 

106. The system of claim 67, wherein the set of face classifier parameters are fourier 
components derived from a 2d fourier transformation of the normalized face region. 

107. The system of claim 67, wherein the set of face classifier parameters are discrete fourier 
transform vectors derived from a 2d discrete cosine transform of the normalized face region. 

108. The system of claim 67, wherein the set of face classifier parameters are wavelet transform 
components derived from a 2d wavelet transform of the normalized face region. 

109. The system of claim 67, wherein the set of face classifier parameters are gabor transform 
components derived from a 2d gabor transform of the normalized face region. 

1 10. The system of claim 67, wherein the set of face classifier parameters comprises a 
combination of two or more of principle components vectors, independent component vectors, 
fourier components, discrete cosine transform components, wavelet transform components and 
gabor transform components. 

111. The system of claim 110, wherein the set of face classifier parameters includes additional 
classifiers or subsets thereof which further characterize the shape, texture, color distribution or 
localized physical features of the face region. 

1 12. The system of claim 110, wherein the set of face classifier parameters may be subdivided 
into two or more subsets of face classifier parameters wherein each subset facilitates a particular 
step of the comparing and determining a match of said set of face classifier parameters with a 
previously determined known identity: 

113. The system of claim 1 12, wherein one of said subsets of face classifier parameters verifies 
that the face region is similar enough to the face region of one or more known identities to be 
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correctly recognized; and wherein the second of said subsets of face classifier parameters 
completes the recognition process by determining which of said known identities said face 
region should be associated with. 

1 14. The system of claim 67, wherein the archiving further for enabling further comparisons 
with further faceprints and for recalling the faceprints and their associated normalized face 
regions and parent images. 

115. The system of claim 67, wherein the generating further comprises performing one or more 
additional normalizing operations. 

1 16. The system of claim 1 15, wherein the one or more additional normalizing operations 
comprise luminance, size, or orientation normalizing, or combinations thereof. 

117. The system of claim 67, wherein the generating further comprises size normalizing of said 
face region. 

1 18. A processor-based system operating according to digitally-embedded programming 
instructions and communicating with one or more digital data storage media for classifying and 
archiving images including face regions that are acquired with a digital image acquisition device, 
the programming instructions comprising: 

(a) a normalization module for generating a normalized face region from an identified 
face region within digital image data acquired by the acquisition device, the generating 
comprising: 

(i) determining the pose of a confirmed face region; 

(ii) mapping said face region onto a 3d average-face model to create an interim 
3d model of said face region; 

(iii) rotating said interim 3d model into full frontal alignment; and 

(iv) translating the facial aspect of said interim 3d model back onto 2d image 
space to create a pose normalized face region; and 
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(b) a workflow module providing for the automatic or semiautomatic processing of the 
pose normalized face regions. 

1 19. The system of claim 118, wherein the determining of the pose of a confirmed face region 
further comprises: 

(i) determining locations of principle facial feature within said face region; 

(ii) determining at least two geometric relationships between said facial features; 

(iii) extrapolating from said geometric relationships the plane of the facial region, relative 
to the normal plane of the image acquisition apparatus thereby determining the facial pose 
relative to the normal plane of the image acquisition apparatus. 

120. The system of claim 1 19, wherein said principle facial features comprise at least two of 
eye-pair, nose and mouth regions. 

121. The system of claim 118, wherein said determining of the pose of a confirmed face region 
comprises: 

(i) determining the locations of principle facial feature within said face region; 

(ii) determining at least two geometric relationships between said facial features; and 

(iii) extrapolating from said geometric relationships the plane of the facial region relative 
to the normal plane of the image acquisition apparatus, thereby determining the facial pose 
relative to the normal plane of the image acquisition apparatus. 

122. The system of claim 118, wherein said mapping of said face region onto a 3d average- face 
model comprises an additional rescaling of said 3d average face model along at least one 
horizontal dimension, said additional rescaling being based on the at least two geometric 
relationships determined in the pose determining. 

123. The system of claim 118, the normalizing further comprising performing one or more 
additional normalization operations on said pose normalized face region. 
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124. The system of claim 123, wherein the one or more additional normalization operations 
comprise luminance, size, or orientation normalization, or combinations thereof. 

125. The system of claim 118, the normalizing further comprising size normalizing of said face 
region. 

126. The system of claim 118, wherein the automatic processing provided by the workflow 
module comprises: 

(i) comparing said extracted faceprint to a database of archived faceprints 
previously determined to correspond to one or more known identities, 

(ii) determining based on the comparing whether the new faceprint corresponds to 
any of the one or more known identities, and 

(iii) associating the new faceprint and normalized face region from which said 
faceprint is derived with a new or known identity within a database comprising other data 
corresponding to the archived faceprints and associated parent images for performing further 
comparisons with further faceprints, such as to permit data corresponding to the new faceprint 
and its associated parent image to be archived according to the associating by the workflow 
module within one or more digital data storage media. 

127. The system of claim 118, the workflow module further for digitally organizing and 
selectively recalling said archived faceprints and the associated parent images. 

128. The system of claim 118, further comprising a set of user interface modules for obtaining 
user input in the classifying of faceprints and their associated normalized face regions and parent 
images. 

129. A method for classifying and archiving images including face regions that are acquired 
with a digital image acquisition device, comprising: 

(a) generating a pose normalized face region from an identified face region within digital 
image data acquired by the acquisition device; 



Gray Cary\SF\309750l.l 
2100874-991430 



-93- 



Attorney Docket: 2100874-991430 (FN- 103-D) 



(b) extracting a set of face classifier parameter values, collectively referred to as a 
faceprint, from the pose normalized face region; 

(c) comparing said extracted faceprint to a database of archived faceprints previously 
determined to correspond to one or more known identities, 

(d) determining based on the comparing whether the new faceprint corresponds to any of 
the one or more known identities, and 

(e) associating the new faceprint and normalized face region from which said faceprint is 
derived with a new or known identity within a database comprising other data corresponding to 
the archived faceprints and associated parent images for performing further comparisons with 
further faceprints, such as to permit data corresponding to the new faceprint and its associated 
parent image to be archived according to the associating by the workflow module within one or 
more digital data storage media. 

130. The method of claim 129, wherein one or more archived faceprints have been previously 
determined to correspond to the one or more known identities, and the comparing comprises 
determining proximities of the values of the face classifier parameters of the new face print 
image with values corresponding to the one or more archived faceprints. 

131. The method of claim 130, wherein the proximities of the values correspond to proximities 
of locations in a multi-dimensional mathematical space defined by the set of face classifier 
parameters which correspond to a faceprint. 

132. The method of claim 131, further comprising statistically calculating at least one proximity 
based on comparisons with multiple archived faceprints corresponding to a same identity. 

133. The method of claim 130, wherein the determining comprises automatically determining 
that the new faceprint corresponds to a known identity based on one or more geometric distance 
proximities being within a predetermined proximity threshold. 
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134. The method of claim 133, further comprising statistically calculating at least one proximity 
to be within the threshold when the probability that the proximity is within the threshold is above 
a predetermined probability value. 

135. The method of claim 133, wherein the predetermined proximity threshold comprises a first 
threshold, and the determining comprises requesting user confirmation whether the normalized 
face region associated with the new faceprint corresponds to a known identity when a geometric 
distance proximity is outside the first threshold and within a second threshold greater than the 
first threshold. 

136. The method of claim 135, statistically calculating at least one proximity to be within a 
threshold when the probability that the proximity is within the threshold is above a 
predetermined probability value. 

137. The method of claim 135, wherein the determining comprises automatically determining 
that the new faceprint does not correspond to a known identity based on one or more geometric 
distance proximities being outside the second threshold or a third threshold greater than the 
second threshold. 

138. The method of claim 130, wherein the determining comprises automatically determining 
that the new faceprint corresponds to a known identity when comparisons of the face classifier 
parameter values of the first face print with multiple archived faceprints corresponding to a same 
known identity each result in a determination of an identity match. 

139. The method of claim 130, wherein the determining comprises requesting user confirmation 
whether the new faceprint corresponds to a known identity when comparisons of the face 
classifier parameter values of the first faceprint with multiple archived faceprints corresponding 
to a same known identity result in at least one determination of an identity match and at least one 
determination that the identities do not match. 
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140. The method of claim 130, wherein the determining comprises requesting user confirmation 
whether the new face print image corresponds to one or more known identities when 
comparisons of the face classifier parameter values of the new faceprint with multiple archived 
faceprints corresponding to multiple known identities result in determinations of identity 
matches with at least two different identities. 

141. The method of claim 129, wherein the associating comprises grouping the new faceprint 
with a new or prior face class defined by values of one or more face classifier parameters. 

142. The method of claim 141, wherein when the determining results in no identity matches 
between the new faceprint and any known identity, the method further comprises: 

(i) determining that the new face print image corresponds to a new identity; 

(ii) grouping the new face print image with a new face class defined by sets of boundary 
face classifier parameter values. 

143. The method of claim 129, further comprising determining that a new image is presented for 
face detection processing. 

144. The method of claim 129, further comprising obtaining user input in the detection of face 
candidate regions. 

145. The method of claim 129, further comprising classifying, archiving or recalling of 
faceprints or associated normalized face regions, or combinations thereof. 

146. The method of claim 129, further comprising verifying that the face region is similar 
enough to a face region of one or more known identities to be correctly recognized. 

147. The method of claim 146, further comprising completing the recognition process by 
determining which of said known identities said face region should be associated with. 
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148. The method of claim 129, wherein the generating further comprises performing one or 
more additional normalizing operations. 

149. The method of claim 148, wherein the performing comprises luminance, size, or orientation 
normalizing, or combinations thereof. 

150. The method of claim 129, wherein the generating further comprises size normalizing of 
said face region. 

151. The method of claim 129, further comprising archiving the new faceprint and its associated 
parent image, according to the associating, within one or more digital data storage media. 

152. The method of claim 151, wherein the archiving of the new data corresponding to the face 
classifier parameters of the new faceprint corresponding to the new identity comprises 
associating the new data with archived data corresponding to one or more known identities based 
on a relationship between the new identity and the one or more known identities. 

153. The method of claim 151, wherein the archiving of the new data corresponding to the face 
classifier parameters of the new faceprint corresponding to the new identity comprises 
associating the new data with a further new identity based on a relationship between the two new 
identities. 

154. The method of claim 151, wherein the archiving of the new data corresponding to the face 
classifier parameters of the new faceprint comprises generating a new face class defined by sets 
of boundary face classifier parameter values including the particular face parameter values of the 
new face print image. 

155. The method of claim 154, wherein the archiving further comprises grouping the new face 
class with another face class within a same identity table corresponding to a same appearance of 
a known identity. 
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156. The method of claim 155, wherein the archiving further comprises adjusting boundary face 
classifier parameter values of a different identity based on adjusted boundary values of the 
identity including the new face class. 

157. The method of claim 154, wherein the archiving further comprises grouping the new face 
class within a first identity table, and grouping the first identity table with a second identity table, 
including a second face class, together within a same appearance table corresponding to a 
different appearances of a same known identity. 

158. The method of claim 157, wherein the archiving further comprises adjusting boundary face 
classifier parameter values of a different identity based on new or adjusted boundary values of 
the identity including the new face class. 

159. The method of claim 154, wherein the archiving further comprises grouping the new face 
class within a previously generated identity table including multiple face classes corresponding 
to multiple different values of face classifier parameters corresponding to a same appearance of a 
same identity. 

160. The method of claim 161, wherein the archiving further comprises adjusting boundary face 
classifier parameter values of the identity based on parameters of the new face class. 

161. The method of claim 160, wherein the archiving further comprises adjusting boundary face 
classifier parameter values of a different identity based on parameters of the adjusted boundary 
values of the identity including the new face class. 

162. The method of claim 151, wherein the archiving of the new data corresponding to the face 
classifier parameters of the new faceprint comprises grouping the new faceprint within a 
previously-determined face class defined by sets of boundary face classifier parameter values 
including particular face classifier parameter values of the new faceprint. 



Gray Cary\SF\309750 1.1 
2100874-991430 



-98- 



Attorney Docket: 2100874-991430 (FN- 103-D) 



163. The method of claim 162, wherein the archiving further comprises re-defining the 
boundaries of the previously-determined face class based on one or more particular face 
classifier parameter values of the new faceprint being outside previously established boundary 
values. 

164. The method of claim 162, wherein the face class has been previously grouped with one or 
more other face classes within a same identity table corresponding to a same known identity, and 
wherein the archiving further comprises adjusting boundary values of the identity table based on 
adjusted boundary values of the face class including the new faceprint. 

165. The method of claim 151, wherein the archiving enabled further comparisons with further 
faceprints and recalling of the faceprints and their associated normalized face regions and parent 
images. 

166. The method of claim 129, further comprising digitally organizing and selectively-recalling 
said new and archived faceprints and the associated parent images. 
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